@imcaizheng which OS did you use for testing docker-compose files Linux or macOS?

When I'm starting on macOS kafka-client which suppose to create topics never stops for me (cannot connect to Kafka):

Thus ex-processor never starts:

My docker version seems correct:

@maxceem I tested on Linux. It is supposed to work with MacOS, too.

I can reproduce the issue by just running kafka-client alone(without kafka being running). So I guess it's because the kafka did not bring up successfully when your ran the docker-compose file.

To troubleshooting the issue, please try with the following steps:

1. start kafka along with zookeeper: docker-compose -f local/docker-compose.yaml up zookeeper kafka
2. make sure kafka and zookeeper are running and ready by checking logs: docker-compose -f local/docker-compose.yaml logs kafka and docker-compose -f local/docker-compose.yaml logs zookeeper
3. start kafka-client: docker-compose -f local/docker-compose.yaml up kafka-client
4. see whether the issue still exists.

Also, you may try to clean any existing containers by running docker-compose -f local/docker-compose.yaml rm -f.

Thanks for details.

I've tried to follow these steps. Kafka and zookeeper seems to run well, but kafka-client cannot connect to it.

I guess there is some network config issue, maybe the new way of defining external hosts doesn't work properly on macOS host.docker.internal:host-gateway. So I guess we would have to use an old way of defining host.docker.internal which we previously used in Projects API and which is used in the second place submission.